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I. THE PROBLEM 

ness of the vocational education, a heightened aware- 

of formalized nroblem and a growing belief in the value 

program ofL^arehto oSch Ser^s’'matoT'“'”“ 

Of significant problSns in pubfic vSional ^ priority 

suitable for guiding potential investieatnrQ^ technical education in Minnesota 
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“■ Sic "pro’^arto *?sSte?“ '““tivene® ot the trade and 

b. What is the preferred order in which these problem areas should be studied? 

" SsL^d^S"' •»e probiem 

”■ » a"S.?dTe?nvS^^^^^ 

’■ Stilus -ssss 

“*■ Schiga^tlsrpemfii^^^^^^^^ of studies 

a. What common problem areas have been identified? 

'’• onht^»^ i- eaeh 

II. PROCEDURES 

^ststant Direc tor of Vocational Education, the Sta“super^L“of Ma^owe?TjSi“^ 

of Vocatiomil EtocatSon, “RraSh Prob&is””tSm aS? M^h™ 

Hairoburg, Pa., PennsylvMia Departmenl PubHc'lmtraSlon 196^^^^ "’ 

convei4ly!^i4^^oll lefflA^W^oftlre stufcnts'*^ a«‘*' 'In'™''?? >" the State; 

home economics programs. agriculture, business, distributive, and 
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the State Supervisor of Trade and Industrial Education, and the two Assistant State Suner- 
visors of Trade and Industrial Education (n=6). ^ 

The second sample (n=8), called the “related vocational fields” sample, consists of 
the four head teacher trainers and the four State Supervisors of Agriculture Business 
Distributive, and Home Economics Education. ’ ’ 

Data Collection Ninety-eight percent (n=28) of the trade and technical sample and 
38% (n 3) of the related vocational fields sample attended a conference designed to 
develop a list of problems which appear to be limiting the effectiveness of the trade 
and technical program in the State. No reference was made to lists of problems developed 
in Michigan or Pennsylvania. ^ 

The p-oblems suggested during the conference were rephrased and incorporated in 
an opinionnaire containing eighteen problem areas The opinionnaire, together with an 
explanatory coyer letter, was then sent^ to both samples with instructions to “. . . indi- 
cate your opinion of the relative importance of each problem listed below by ranking 
them m the consecutive order in which you feel they should be studied. The rank of 
one (1) represents the highest priority. Use the space at the bottom of the list to add 
^gnincant problems that are not shown and include these additions in your ranking ” 
Rephes were received from 98% (n=28) of the trade and technical sample and 100% 
of the related vocational fields sample. 

Treatment of Data. To determine the consistency with which an individual might 
be expected to rank eighteen items, the opinionnaire v/as administered three times to five 
membe^« of the trade and technical sample, using intervals of three days and forty-five 
dajs. The respondents did not know they would be retested. Spearman rank order cor- 
relations were calculated. Table 1 presents the results. 

Table 1. 

TEST-RETEST COEFFICIENTS OF RELIABILITY OF THE OPINIONNAIRE 

(Rank order) 



Interval 


1 


2 


Sample Member 
3 


4 


5 


Average r' of the 
Five Members* 


3 days 


.95 


.94 


.89 


.90 


.94 


.93 


45 days 


.86 

-rf 


-.11 


.22 


.60 


.55 


.50 



. ability of the opinionnaire to reflect an individual’s current opinion satisfactorily 
IS shown by the high correlations obtained between two administrations given three days 
apart. On the other hand, the opinionnaire’s sensitivity to actual change of individual 
opinion is reflected in the much lower correlations obtained when consecutive adminis- 
trations were separated by forty-five days. 

Further evidence of the short term stability of the opinionnaire was secured by cor- 
relating the average of the five members’ ranks for each problem area on one administra- 
tion with their average ranks on the second administration given three days later; a rank 
order coefficient of .96 was obtained, indicating the high reliability of the average ranks 
of the sample. 

To find the preferred order in which the problem areas should be studied, the average 
rank of eac h problem area was computed for the trade and technical sample, the three 

* A complete list of the eighteen problem areas is given in Appendix A. 

® The list of problems was developed prior to, and the opinionnaire was mailed subsequent 
to, the passage of the Vocational Education Act of 1963. 

* Because the Vocational Education Act of 1963 was passed during the 45 day interval, 
the individuals completing the opinionnaire stated that they were conscious of varying amounts 
of actual change of opinion. For example, the importance of improving the “image” of the 
field was initially given a top priority by one individual, but after the Act made additional 
funds nvailnble, he felt that the problem should be assigned a very low priority. 









subsamples within the trade and technieal sampte, fte ^ 

SSiitXte“5istl“u«^J%T^^ 

relatively homogeneous groupings of average ranks. Pnont.es of problem areas were 

nf “common” oroblem areas within each study. Rank order correlations between problem 
aLs“onT^^^ and I&innesota-Pennsylvama were calculated. 

m. FINDINGS 

Oue^tion la In the opinion of vocational educators who are rnost familiar with the 
^tSewide oroeram of public trade and technical education, and who are in a position to 
encZmgeUifect, aid! or support research, what problem ^eas appear to be limiting the 
effectiveness of the trade and technical program in the State. 

Annenriix A and Table 2 contain the list of problem areas considered by thirty-one 
persons in attmdanoe at the conference to be most signfflcant in limiting the effectiveness 

“'&?he1aS am® oTpre'^^^^^ was developed prior to .«he. passage of 
the Vocational Education Act of 1963, and opinions concerning their relative importance 
were obtained subsequent to the passage of the Act, only three additional probleni ar a 
were suggested by the opinionnaire respondents. The suggested 

3 S vs loLl control and financing of area schools, the effect of lack of transpor- 
Ttion on and the operation of high school and post-high 

school vocational guidance programs. It is not possible to estimate what the relative 
tance of these problem areas would have been had they been included in the opinionnair . 

Question lb. What is the preferred order in which these problem areas should be 

2 presents the order in which the trade and technical sample feels the problem 

^"^^Wejhting tL^ opinion of each member of this sample equally, the degree agree- 
ment aSI individuals, as measured by the coefficient of concordance, was found to 
be nTsiLniSt ^ the .01 level). Because of the low extent of agreement, indicating 
a lack of real consensus, priorities are reported by groups of problem areas. 

Question 2a. When vocational educators who are most familiar with the 
program of trade and technical education are organized into ^^J^^ories of area 
ZmStrators, teacher trainers, and State Department personnel, what is the preferred 
order in which each of these categories feel the problem areas should be studied. 

» W = Sum of squares between problems 
Total sum of squares 
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6.5-6J 



7.2-7J 



/-M u j Problem Areas 
( umbered as listed on the opinioimaire) 

'■ S/educatiSj^s !?,>“' “> “Ms-^harge 

Seats «“■ 

' ‘ ^SSm>5s' ~ 

^ a"7urdatingoTS^^^^ 



S.2-8.9 



9.4-9.9 



class ?SocUil“tc.)T’ materials, length of 



11. 



17. 



10. 



high schools vs. comprehensive high schools)?’ * 

efch'^of tte quantitative need for workers 

what non and industrial occupations by 1970? In 

what geographical areas will these needs be ceLred? 



'’13. What programs can be devised to recruit eselent qi,,i ♦ • 
vocational supervisors, coordinators, and dtcto???^* 

**■ artfevS?eS' anrtLSrrlte\""'oS'^“' 

curricula? pieiion rate in our vocational 



What^ relative emphasis should be nlarpH in 

curricula on the attainment of specialized^ im^ 
mediately productiye skills yersus the develonmtnt 

^tafnfna greater breadth and flexibility ?rf 

attaining long-range occupational goals? ^ 
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10.6-11.3 



11.8 



13.4 



Table 2 (Continued) 

^ OTov/n?Arfc^^"^ 

proving the image of vocational and technical education? 

3. What is the “image” of vocational and technical education 
s?ud?nl.Tdttr°y! (administrators, teachU 

combination distribu- 

St fhese 

®'^*dence can be secured illustrating the relative 
vocational vs. non-vocational programs 
program?) Personal ^*ad social benefits of vocational 
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common points of view. Consequently, Tablef 4^^ anVe Jeno®i?th<.°^“*°?® 

etrptS/h^a^s bWit“ 

or^rin which fhe^obllTaiel^ preferred 
areas between pairs of Sle^d tMtoi?d°suSSpl“f* pnority rankings of problem 
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Table 4. 

preferred order ™^^CH GROure of problem areas 

AREA SCHOOL DIRECTORS AND ASSISTANT DIRECTORS 

- (n=17) 



Rank of 
Groups of 
Problem 
Areas 



Range of 
Average Ranks 
Within Each 
Group 



Problem Areas* 



6.9-7. 1 
S.3-9.3 
10.2-10.9 
11.5-12.2 



2, 5, 14, 9 

J. .5, _n, .7, 6. .8, 4 

3, 12 
16, 8 




Table 5. 

tr!i^’^S°” 

TRADE AND TECHNICAL TEACHER TRAINERS 
— (n=5) 



Rank of 
Groups of 
Problem 
Areas 



4 

5 

6 

7 

8 



Range of 
Average Ranks 




3. 0-3 .4 
6.1 

7.7- 7.9 

8.7- 9.2 
10.4 

11 . 2 - 12.0 
13.4-13.8 
16.6 



5, 1 
9 

18, 17, 14 
10, 12, 2, 15 

6 , 11 

3, 13, 7 
16, 4 
8 



Append^ AO “ fl>«y "e liaed on ihe opmionnaire. (See 

Table 6. 

preferred ORDER PROBLEM AREAS 

SELECTED STATE DEPARTMENT PERSONNEL 
- (n=6) 



Rank of 
Groups of 
Problem 
Areas 



Range of 
Average Ranks 
Within Each 
Group 



Problem Areas* 



1 

2 

3 

4 

5 

6 
7 



4.6- 4.7 

5.7- 63 

7.8- 8.7 

9.5- 10.5 

11.5- 12.0 
13.2 

14.3-14.5 



Appe“^Bt“A0 "mnbered 



6, I 
13, 2 

11, 5, 15, 14 

3, 10, 17, 9 

4, 18, 7 
12 

8, 16 



as they are listed on the opinionnaire. (See 
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Area School 
Administrators 



Trade and Technical 
Teacher Trainers 



(n=17) 



Selected State 
Department Personnel 
(n=6) 

.64** 



Trade and Tech- 
nical Teacher 
Trainers (n=5) 



S’’ agriculture, busfS, "’** specific statewide respoitsi. 

In A aM 



rvrui^n me 

tShTp problem areS^were Soun?d n* ^**®**‘ ‘“dividual rankings 



Table 8. 

preferred order in WHIPH ppormc r \ r ^ 



Rank of 
Groups of 
Problem Areas 



1 

2 

3 

4 

5 

6» 

7 

8 



Range of 
„ Average Ranks 
Within Each Group 



Problem Areas* 



5.6- 5.8 
6.8- 7.3 
8 . 0 - 8.8 
10.0-10.5 

11.5 

12.8 

14.5 
17.3 



14, 10 
13, 5, 2 
1, 4, 9, 15, 3, 7 
11, 17, 6 
12 
18 
.'6 
8 
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vocational education problems in that State by securing nominations and ratings from a 
research project advisory committee, State vocatior al supervisors, and the vocational and 
practical arts teacher training staff at the University of Michigan. Thirty-seven problems 
were accumulated and ranked. 

Twenty-one of Michigan’s vocational problems seem comparable to eleven of Minne- 
sota’s trade and technical problem areas. Table 9 gives the common problem areas. 

Appendix B lists the sixteen Michigan problems for which Minnesota has no direct 
counterparts. In the opinion of the Michigan respondents, six of these problems rank in 
the first (upper) quartile of all problems in importance, two are in the second quartile, 
three are in the third quartile, and five are in the fourth (lowest) quartile. 

The 1960 Pennsylvania study utilized eighty-five criteria for evaluating local programs 
of trade and industrial education as the major source list for problem statements. Sixty- 
eight local directors, principals, and trade and industrial coordinators (about 70% of the 
desired sample) rated these problems plus thirty-four additional (respondent suggested) 
problems. A rank order was ascertained. 

Only the fourteen most important (of the total one hundred and nineteen) problems in 
Pennsylvania’s trade and industrial program were reported; these have been compared 
with Minnesota’s eighteen problem areas. Twelve of the fourteen problems correspond 
to eight of the Minnesota problem areas. These are shown in Table 9. 

Appendix C lists the two Pennsylvania j^roblems for which Minnesota has no direct 
counterparts; they fall into the first and third quartiles of the fourteen most significant 
Pennsylvania problems. 

All but one (number 6) of the thirteen top-ranked Minnesota problem areas have been 
considered significant enough by Michigan and/or Pennsylvania to include in their rank- 
ings. Only one (number 12) of the five lowest ranked Minnesota problem areas has been 
considered sufficiently important (by Michigan) to be ranked at all. 

Table 9. 

COMMON PROBLEM AREAS IDENTIFIED BY STUDIES 
IN MINNESOTA, MICHIGAN, AND PENNSYLVANIA* 



Minn. 


Mich. 


Penna. 


Problem 


Problem 


Problem 


Areas** 


Areas 


Areas 


1 


X 




2 




X 


3 


X 




4 




X 


5 


X 


X 


6 






7 






8 






9 


X 


X 


10 


X 


X 


11 


X 




12 


X 




13 


X 




14 


X 


X 


15 




X 


16 






17 


X 




18 


X 


X 



*An (x) indicates that the Minnesota problem area has also been identified 
by the other State. 

** Problem areas are numbered as they are listed in Appendix A. 

Question 4b. To what extent are the priorities assigned to common problem areas in 
each of the other studies in agreement with the priority found in this study? 
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mon problem areas^^a^houeh^therp ®*®tjstically significant relationships between com- 
vania to assSn mverse^^^^^^ slight tendency for both Michigan and PennsS- 

Minnesota. areas which each has in common S 

Table 10. 

SiAs'f rankings of 

COMMON TO MINNESOTA AND 
MICHIGAN, AND TO MINNESOTA .WD PENNS^^ 



Michigan 

fn—l 1 ^ 



Pennsylvania 




2 . 



3. 



IV. CONCLUSIONS 

restricted 

tioned that the value Tfte ^ ““Pleted- reader is, therefore, cau- 

ScZd?re“?ctTti<Sf opto^sr^iS 

and/or priority of prebiems that etdst. Within the'se Itotatton^ ”St‘ bTconeSdel 

Spearto brsiSffic^^^ f problem areas which 

o/“ eaVhcS'l^Statore ttfde“»d"tectoteal°re ”h“ groups 

State Department pereonnMlJ p^ttal&tbe'^Sd " 

S'aTed7l!“ors^sTTrefc™d ?rter“ ‘“>- 

simiiarities and diflerenMs in^he nMme^f mdicate that 

to be reflected in their ehdce of prebil" ^e^^rioE' “ 

not'tiT”' 

as those of the trade and technical educSolc^^^^H disparate 

with the resuits remmd in S fa^ S'"' ™”8e opinion agrees 

technicai education a^ aiMng tfeULdves ^ ® 

wS®*is“smdy°SsXst'impoSt!^^^^ 
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V. IMPLICATIONS 

1. It is inevitable that, in evaluating proposals submitted to the State for funding, 
some consideration be given to their immediate educational significance. The re- 
sults of this study should contribute to this aspect of the total evaluation. But be- 
cause individuals most intimately acquainted with the State’s trade and technical 
program do not agree upon the most desirable priority in which to investigate 
problems, care must be taken not to weight immediate educational significance 
too heavily, or to use too fine a scale in its measurement. 











2. If the type and relative importance of problems expressed by educational practi- 
tioners are directly affected by their perception of changing conditions, then it is 
necessary, especially in the rapidly evolving vocational program, to keep the list of 
problem priorities current if it is to maintain its usefulness. 

3. In addition to the desirability of maintaining a- current list of problems for research 
and administrative purposes, repetitive measures should reveal the “persistent” prob- 
lems, and might also provide an opportunity to evaluate program progress, in- 
directly and subjectively, by utilizing change in perceived problems as a criterion. 



APPENDIX A 

PROBLEM AREAS IDENTIFIED BY MINNESOTA CONFEREES 
(Shown in the order in which they were listed on the opinionnaire) 

1. How can the high school years be best used to discharge public education’s total respon- 
sibility for preparing students to enter the world of work? 

2. What responsibility does vocational education have for providing curricula for the 
“low ability” student and the potential high school dropout? What can it do for those 
students? 

3. What is the “image” of vocational and technical education in the minds of its publics (ad- 
ministrators; teachers, students, industry, labor, etc.)? 

4. What techniques and procedures are most effective in improving the “image” of vocational 
and technical education? 

5. How can we improve the techniques for identifying the occupations for which training 
should be provided? 

6k For what operative (semi-skilled) occupations should the schools provide training? At what 
educational level(s)? How? 

7. Are there occupations that require combination distributive-trade and industrial programs? 
How, when, and where might these be offered? 

8. What specific occupations will emerge from the taconite industry? 

9. How can we improve our methods for identifying and developing the curriculum and 
specific course content used to train for a given occupation? 

10. What relative emphasis should be placed in preparatory vocational curriculai on the attain- 
ment of specialized, immediately productive skills versus the development of abilities per- 
mitting greater breadth and flexibility in attaining long-range occupational goals? 

11. What are the relative merits of the administrative structure and educational opportunities 
provided by (a) specialized and (b) comprehensive institutions (i.e. area vocational-techni- 
cal schools vs. community colleges, vocational high schools vs. comprehensive high schools)? 

12. What evidence can be secured illusti ating the relative effectiveness of vocational vs. non- 
vocaticnal programs (to show the personal and social benefits of vocational programs)? 

13. What programs can be devised to recruit, select, and train vocational supervisors, coordi- 
nators, and directors? 

14. How can we improve the recruitment, selection, training, and updating of vocational in- 
structors? 

15. How can we improve the efficiency and effectiveness of the classroom and shop teaching- 
learning situation (methods, class size, instructional materials, length of class periods, etc.)? 

16. >^^at is the extent of geographical mobility among youth and workers in the State? 

17. What will be the statewide quantitative need for workers in each of the trade and industrial 
occupations by 1970? In what geographical areas will these needs be centered? 

18. What are the objective measures which will predict student achievement and completion 
rate in our vocational curricula? 



14 



f 



APPENDIX B 



MICHIGAN PROBLEMS NOT DIRECTLY RELATED TO 
MINNESOTA PROBLEM AREAS 



Quartile 

Problem Rank 



1. To determine the need for, and feasibility of area vocational schools in Michigan. 1 

2. To determine the essential services and organization of an effective vocational 

guidance program. 1 

3. To determine the organizational relationships of vocational education programs 

in community colleges and the high schools within their service areas. 1 

4. To determine the individuals or groups who make the decisions relative to the 

operation of vocational education at the local, state and national levels with 
particular emphasis at the local level. 1 

5. To determine the essential characteristics and organization of a program for re- 
training displaced adult workers. 1 

6. To make an opinion survey of local school administrators to determine the an- 

ticipated effect of a gradual withdrawal of special reimbursement on the high 
school program, on the teacher-education program, and on the post-high school 
programs. 1 

7. To appraise the research in vocational education to determine scope and quality. 2 

8. To catalogue the opinions of school and community leaders on ways of better 

utilization of community resources in cooperative occupational training, ap- 
prenticeship, work experience, and job-upgrading programs. 2 

9. To describe the organizational structure of vocational education in Michigan 

and the kinds of services rendered. 3 

10. To determine the structure, goals and activities of school, community, state and 

federal agencies concerned with vocational education and to show the interrela- 
tionships among them. 3 

11. To determine the extent to which lay advisory committees are being used and 

to assess the opinions of school and lay persons as to the value of lay advisory 
committees. 3 

12. To analyze the areas of responsibility of practical arts and of vocational educa- 

hoti and to determine the administrative relationships between them. 4 

13. To determine the extent to which the Michigan Council for Vocational Educa- 
tion Atoinistration is representative of those groups interested in and concerned 

with the administration of vocational education. 4 

14. To determine the quantity and quality of vocational education courses offered 

by correspondence schools. 4 

15. To analyze the programs and activities of selected professional organizations 

in Michigan to determine how effective they are in providing leadership in vo- 
cational education. 4 

16. To determine the existing administrative relationships between public and pri- 
vate technical education. 4 

APPENDIX C 

PENNSYLVANIA PROBLEMS* NOT DIRECTLY RELATED TO 
MINNESOTA PROBLEM AREAS 



Quartile 

Problem Rank 



1. The identification and proper installation of safety devices for various trade 

areas. \ 

2. Methods of securing support for an adequate budget for a T. & I. program. 3 



*Including only the top-ranked fourteen problems. 
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